Asymptotic Equipartition Property of Output when Rate is above Capacity

نویسندگان

  • Xiugang Wu
  • Liang-Liang Xie
چکیده

The output distribution, when rate is above capacity, is investigated. It is shown that there is an asymptotic equipartition property (AEP) of the typical output sequences, independently of the specific codebook used, as long as the codebook is typical according to the standard random codebook generation. This equipartition of the typical output sequences is caused by the mixup of input sequences when there are too many of them, namely, when the rate is above capacity. This discovery sheds some light on the optimal design of the compress-and-forward relay schemes.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Empirical distribution of good channel codes with non-vanishing error probability (extended version)

This paper studies several properties of channel codes that approach the fundamental limits of a given (discrete or Gaussian) memoryless channel with a non-vanishing probability of error. The output distribution induced by an ǫ-capacity-achieving code is shown to be close in a strong sense to the capacity achieving output distribution. Relying on the concentration of measure (isoperimetry) prop...

متن کامل

Lossy Asymptotic Equipartition property for Networked Data Structures

Abstract. This paper presents a rate-distortion theory for hierarchical networked data structures modelled as tree-indexed multitype process. To be specific, this paper gives a generalized Asymptotic Equipartition Property (AEP) for the Process. The general methodology of proof of the AEP are process level large deviation principles for suitably defined empirical measures for muiltitype Galton-...

متن کامل

Properties of a Word-Valued Source with a Non-prefix-free Word Set

Recently, a word-valued source has been proposed as a new class of information source models. A word-valued source is regarded as a source with a probability distribution over a word set. Although a word-valued source is a nonstationary source in general, it has been proved that an entropy rate of the source exists and the Asymptotic Equipartition Property (AEP) holds when the word set of the s...

متن کامل

Gaussian feedback capacity

Abstracl-The capacity of time-varying additive Gaussian noise cbannels with feedback is characterized. Toward this end, an asymptotic equipartition theorem for nonstationary Gaussian processes is proved. Then, with the aid of certain matrix inequalities, it is proved that the feedback capacity C,, in bits per transmission and the nonfeedback capacity C satisfy C 5 CFB < 2C (a result obtained by...

متن کامل

Engineering EE 194 – Network Information Theory Prof . Mai Vu Lecture 2 : Channel Capacity 1 Typicality and Joint Typicality

The Asymptotic Equipartition Property (AEP) in information theory is the analog of the Law of Large Numbers in probability theory. Assume that the binary random variable X has a probability mass function defined by p(1) = 2/3, and p(0) = 1/3, where X1,X2,...,Xn are i.i.d. random variables according to p(x), and we want to observe a realization of the sequenceX1,X2,...,Xn, where n −→ ∞. We will ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • CoRR

دوره abs/0908.4445  شماره 

صفحات  -

تاریخ انتشار 2009